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Abstract 

The origin of the highest energy cosmic rays is stih unknown. At present, the major 
uncertainties are located at energies above ~ 10^^'^ eV, the expected beginning of 
the GZK suppression. This is mainly due to the low statistics available, a problem 
that will be addressed in unprecedented way by the upcoming orbital detectors like 
JEM-EUSO. The detection of very high energy photons is of great relevance for the 
understanding of the origin of this extreme energy cosmic rays (EECR), due to the 
astrophysical information content. However, their discrimination is an experimental 
challenge for current and future cosmic ray detectors. In this work we study the 
statistical separation between hadron and photon showers from space observations 
at energies where both, the Landau-Pomeranchuk-Migdal (LPM) effect and magne- 
tospheric interactions are important for the development of the cascades. We base 
our analysis on the X^ax parameter, which is already a well known composition 
discrimination parameter for ground based fluorescence observatories. Our analysis 
applies to orbiting detectors in general. Nevertheless, we exemplify the practical 
utilization of our technique by estimating a general upper limit to the photon frac- 
tion in the integral flux, attainable by an ideal orbital detector with characteristics 
similar to JEM-EUSO. In the process we describe the resultant asymmetry in the 
photon-hadron discrimination efficiency in galactic coordinates. 
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1 Introduction 



The cosmic ray flux must present, at least, a minor component of ultra high 
energy photons which may receive contributions from different sources. Be- 
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sides the expected flux generated by the propagation of the EECR in the 
intcrgalactic medium [1], photons may also be originated in different astro- 
physical environments, as by-products of particle acceleration in nearby cos- 
mic ray sources (see e.g. Ref. [2]) and, fundamentally, in top-down scenarios, 
even if not currently favored, involving the decay of super heavy relic particles 
or topological defects [3]. Extreme energy photons have not been unambigu- 
ously observed yet. However, it is expected that planned space observatories, 
like JEM-EUSO [4,5,6] and S-EUSO [7], with their unprecedented exposure, 
change this situation in the next few years. 

Ultra high energy photons can interact with the magnetic field of the Earth 
producing electron positron pairs which modify the development of photon 
initiated atmospheric showers (see Ref. [8] and references there in). The prob- 
ability of photon splitting depends on the intensity of the component of the 
magnetic field perpendicular to the direction of propagation of the photon. 
Thus, the characteristics of the corresponding showers strongly depend on the 
geographical position of the impact point and the direction of incidence of the 
incoming primary photon. Additionally, the development of a photon shower is 
affected by the so-called LPM effect (Landau and Pomeranchuk [9,10], Migdal 
[11]), which consists in a reduction of the Bethe-Heitler cross section for pair 
production by photons, producing a delay in the development of the shower. 
Therefore, the longitudinal evolution of high energy photon showers is domi- 
nated by the interplay between these two effects which has a direct impact on 
the practical possibility of discrimination between photon and proton showers. 

In the present work we develop two complementary techniques in order to 
evaluate an upper limit on the fraction of photons relative to proton primaries 
in the integral cosmic ray flux by using the atmospheric depth of maximum 
development, Xj^ax, of the corresponding atmospheric showers. As previously 
mentioned, the characteristics of the photon showers strongly depend on the 
geographical coordinates of the impact point of the shower; therefore, the 
translation of a space observatory along its orbit is a distinctive parameter 
which adds richness and complexity to the analysis with respect to a tradi- 
tional Earth bound observatory and must be taken into account. We apply 
these new techniques to the case of an orbital detector similar to JEM-EUSO. 



2 Proton-gamma discrimination 



Given a sample of N events, an ideal upper limit to the photon fraction may 
be calculated under the a priori assumption that actually no photon exists in 
the sample, 

J^in ^ 1 _ (1 _ Q,)VJV 
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where a is the confidence level of rejection. Eq. (1) has been already used to es- 
timate the photon sensitivity in the experimental context [12]. In practice, the 
probability of the existence of photons must be realistically assessed through 
some observational technique which involves the determination of experimen- 
tal parameters which, in turn leads unavoidably to less restrictive upper limits 
than the previous one. 

In this work X^^x is used as a discrimination parameter between proton and 
photon showers. The program CONEX [13] is used to generate a library of 
proton and photon showers. The proton library consists of ~ 4 x 10^ showers 
following a power law energy spectrum of spectral index 7 = —2.7 in the inter- 
val [10^^'^, 10^^] eV with uniformly distributed arrival directions. The photon 
library consists of more than 5.5 x 10^ showers generated under the same pre- 
vious conditions but the cores were now uniformly distributed on the surface 
of the Earth in order to properly take into account pre-showering (i.e., photon 
splitting) in the geomagnetic field. 

A quantitative assessment of the discrimination power of the X^ax parameter 
can be obtain through the merit factor, 

n.ed|X:..]-n.ed[X^ 

where med[X^^^] is the median of X^^^^ (A = 7,pr) distribution and AXj^„^ is 
one half of the length of the interval of 68% of probability of X-^^^ distribution. 

Fig. 1 shows, in Aitoff projection, a contour plot of med[X^j^^] — med[X^'^^^] as 
a function of latitude and longitude of the core on the Earth, for Q G [30°, 60°] 
(top panel) and Q e [45°, 90°] (bottom panel) and for E e [10^^•^ lO^O] eV. It 
can be seen that there are regions over the Earth surface where this difference 
is larger and in which the discrimination between protons and photons is more 
efficient. Note that for Q e [30°, 60°], the difference between the medians of 
Xmax of the proton and gamma distributions is larger, this is due to the fact 
that, on average, photon splitting is more important for larger values of zenith 
angles. 

Motivated by this result the concept of mask, ^l{i]Lim), is introduced as those 
regions over the Earth surface where 1] is larger than a given value rjnm- Fig. 2 
shows the median of X^ax and the region of 68% of probability as a function 
of primary energy for protons and photons with 9 e [30°, 60°]. For the case of 
photons different masks are considered: fl{r]um — 0) (all events), ^{r)um — 1) 
and fl{r]Lim = 1-5). Note that the masks are functions of primary energy. From 
the figure it can be seen that, for photons, there are three well defined regions. 
The first corresponds to primary energies smaller than ~ 10^^'^ eV in which 
the X^iax distribution is composed of LPM dominated showers. The second 
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Fig. 1. Contour plots of med[Xmaa;] — nied[Xmax] as a function of latitude and 
longitude of the core location on the Earth surface. The showers considered are 
such that e e [30°, 60°] (top panel) and 6 G [45°, 90°] (bottom panel) and for 
E G [1019.8^ lo^O] eV. 

region extends from ~ 10^^'^ eV up to ~ 10^°-^ eV and is such that the X^^^ 
distribution is composed by LPM dominated showers that both, suffer and do 
not suffer photon splitting in the Earth magnetic field. In the third region all 
showers undergo photon splitting which generates, on average, smaller values 
of X^g^^ and smaller fluctuations [14]. 
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Fig. 2. Median and region of 68% of probability of Xmax as a function of primary 
energy for 9 G [30°, 60°]. In the case of photons different masks are considered, 
r]Lim = (aU the events), riLim = 1 and r]Lim = 1-5. 

The X^^^ distributions obtained for masks with larger rjLim allow a better 
separation between protons and photons. However, the total number of events 
also depends on the assumed mask and, in particular, decreases with r/^jm- Fig- 
3 shows the fraction of events as a function of rjnm for different cuts in zenith 
angle and for E G [10^^'^, 10^"] eV. It can be seen that for vertical showers 
larger values of t] are obtained which are also distributed over a wider range, 
again, the photon splitting is more important for larger values of zenith angle. 



Two methods are developed in order to calculate an upper limit for the photon 
fraction. The first one is based on the abundance estimator first introduced in 
Ref. [15], 

1 ^ . 

i=l 

where X^^^ are experimental values of Xmax, N is the sample size and 

p ( Y \ — f-y{Xmax) , 

^-ry^max) f ( Y \ -L f ( Y \ 
J'yy^maxj ~r J pr\^max ) 

with f-y{Xmax) and fpriX^ax) the photon and proton distribution functions, 
respectively, ^x^ax is an estimator of the photon abundance, = N^/N where 
is the number of photons in the sample. The mean value of C,Xr„ax and the 
variance can be written as. 
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Fig. 3. Fraction of events as a function of rjum for different cuts in zenith angle and 
for E e [IQi^-S, 1020] eV. 



(Cx^ax)(c7)='"lC7 + '"2, 



(5) 
(6) 



where Ui — ai — a2, U2 — 0(2, Vi — — + — a\ and V2 — (y.i — q;|. Here 



(7) 
(8) 
(9) 
(10) 



For large enough values of N, ^x^ax is distributed as a Gaussian variable. 
Therefore, the region on the plane Cxmax ~ ^-y of probability p = a is enclosed 
by the functions, 



^ai'^l) =UiCy + U2± 



s{a) 



Vi + V2, 



(11) 



Cj — and c-y = 1. Here s{a) — -\/2 Erf ^(a) where Erf ^(x) is the inverse of 
the error function. 



2 f 



(12) 
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For the case in which $,Xmax is compatible with a pure proton sample, an 
upper limit to the photon fraction, c!^*'*, can be obtained solving the equation 
C(c7 = 0) = C(c™*''), which gives. 



cr" = ^f^^ + ^). (13) 



The distribution functions needed to calculate c™" are obtained from the 
simulated data by using the non-parametric method of kernel superposition 
with adaptive bandwidth [16,15]. 

It can be seen from Eq. (13) that, the larger the sample size, the smaller 
^min Although, it is not obvious from this expression, it is possible to show 
that for larger values of rj also smaller values of c!^'" are obtained. Fig. 4 
shows c™" for a = 0.95 as a function of rjLim, i.e. for different masks, for 
E G [10l9■^ 10^°] eV, e G [30°, 60°] and 9 G [45°, 90°]. In the figure, the solid 
lines show the results for the ideal case of no reconstruction errors, while the 
other curves were obtained under the assumption of a Gaussian uncertainty. 
In the latter case, errors with an uncertainty of 70 g cm~^ for 9 G [30°, 60°] 
and 9 G [45°, 90°] were assumed [17]. It can be seen that c™*" increases with 
VLim, which means that although the discrimination power of Xmax increases, 
the number of events decreases so rapidly producing larger values of c!^**^, i.e. 
in this case the number of events is more important than the discrimination 
power of Xmax for a given mask. 
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The second method developed here consists in finding a cut on Xjnax which 
minimizes the expression of the upper hmit obtained assuming a pure proton 
composition, 

where Na{n) is the upper hmit on the number of photons n at a confidence 
level a obtained assuming a Poisson distribution and, 

^Ai^max) = / d^max /^(^moa;)- (15) 



In order to study the upper limit for a given threshold energy, the distribu- 
tion functions of Xmax for protons and photons of a given primary energy are 
obtained from MC data, by using the non-parametric method of kernel super- 
position mentioned above. Fig. 5 shows the estimates of the proton and photon 
distribution functions for 9 G [30°, 60°] in energy bins of Alog(ii^/eV) = 0.1 
where the energy corresponding to the center of the bin goes from iQi^-^s 
(top-left panel) up to 10^"-^^ eV (bottom-right panel). It can be seen that, as 
the energy increases the bump due to the photons that do not convert in the 
geomagnetic field becomes progressively less important. 

The broken power law energy spectrum from Ref. [18] is considered in order to 
obtain the distribution functions of X^ax for protons and photons for a given 
threshold energy {E > Eth)- The number of events above a given energy are 
taken from Ref. [18] which corresponds to an orbital detector like JEM-EUSO 
with two years in nadir mode plus three years in tilt mode {aTut = 38°). 

Fig. 6 shows J^uhiX^g^^) as a function of X^^^ obtained by using the distribu- 
tion functions of Fig. 5 convoluted with the energy spectrum for a = 0.95 and 
for 9 e [30°, 60°]. Here a 50% of reconstruction efficiency due to the effects 
of clouds is assumed [17]. It can be seen that Tul{X^^^) reaches a minimum 
which depends on the threshold energy. Note that there is a transition at 
Efh — 10^° eV from which the minimum is reached at larger values of X^^^^. 
This is due to the change in the shape of the photon distribution function when 
the threshold energy increases. Finally, the upper limit is obtained evaluating 
in ^max ^f the minimum. 

In order to exemplify the application of these techniques we consider an orbital 
detector with the following characteristics: 

• As in the second technique describe above, the energy spectrum and the 
number of events are obtained from Ref. [18]. The number of events cor- 
responds to two years in nadir mode plus three years in tilt {aTut — 38°) 
mode for the JEM-EUSO mission. 

• A reconstruction efficiency, taking into account the presence of clouds, of 
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Fig. 5. Estimates of the protons and photons distribution functions of X^ax for en- 
ergy bins of A log(£'/eV) = 0.1 wide and for the bin center energy going from 10^^-^^ 
eV (top- left panel) up to lO^''-^^ eV (bottom-right panel). The showers considered 
are such that G [30°, 60°]. 

eR = 50% is assumed (see Ref. [17]). 
• Although there are estimations of the reconstruction uncertainty of Xmax 
at 10^° eV [17], it is left as a parameter and the upper limits are calculated 
as a function of it . 

In Ref. [17] it is shown that the uncertainty on the reconstruction of Xmax at 
10^° eV increases with zenith angle going from ~ 50 g cm~^ at ^ = 10° up to 
~ 90 g cm~^ at 6' = 80°. This is obtained without using the information given 
by the Cherenkov peak, which is present in a fraction of events. When the 
Cherenkov peak is available much better results are obtained, the uncertainty 
in this case goes from ~ 15 g cm~^ at ^ = 10° up to ~ 40 g cm~^ at ^ = 60°. 
Note that the last method can be used just up to = 60° (see Ref. [17] 
for details). Inspired in these results and considering that the uncertainty 
in Xmax increases at lower energies, a Gaussian distribution with cr[Xmax] £ 
{0, 70, 120, 150} g cm~^ is used in the upper limit calculations. 

Fig. 7 shows the upper limits on the fraction of photons in the integral cosmic 
ray flux, at 95% of confidence level, obtained in the ideal case J^™" (dashed 



9 




Fig. 6. Upper limit as a function of X^^^^ for threshold energies from 10^^-^ eV to 
1020.3 g^(,pg log(E/eV) = 0.1 and for 6 G [30°, 60°] for the ideal case where 

reconstruction error of Xmax is zero. 



line), by using the optimized cut method (solid red lines), by using the $,Xmax 
method (dash-dot-dash blue lines), and also the upper limits obtained by 
different experiments. The calculation is done for £■ > 5 x 10^^ eV and 9 e 
[30°, 80°]. For each method, the lines from bottom to top correspond to a 
Gaussian uncertainty on the determination of X^ax of 0, 70, 120 and 150 g 
cm~^. 

It can be seen that the upper limits corresponding to cr[X^a3,] = 0, obtained 
by using both methods are about one order of magnitude larger than the ideal 
case (dashed line in the figure). This is due to the limitation imposed by the 
Xmax parameter to discriminate between photons and protons. Nevertheless, 
the present analysis can be improved in order to obtain smaller upper limits, 
much closer to the ideal case. This is a work in progress which will be presented 
in a forthcoming paper. 

As expected, the upper limits increases with the uncertainty on Xmax, there- 
fore, it is important to improve the existing reconstruction methods and also 
develop new ones in order to decrease such quantity as much as possible. Note 
that the number of events above a given energy is the only parameter of the 
JEM-EUSO mission used in the present calculation, i.e. given the uncertainty 
on function of the energy for an orbital observatory with a statis- 

tics of the same order of the one of JEM-EUSO, it is possible to estimate the 
attainable upper limits, for the two methods developed here, from the curves 
of Fig. 7. 
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Fig. 7. The upper limits on the fraction of photons in the integral cosmic ray flux 
at 95% of confidence level. Dashed line corresponds to the ideal case in which it 
is known that there is no photon in the data. Solid red lines are the upper limits 
obtained by using the optimized cut method. Dash-dot-dash blue lines are the upper 
limits obtained by using ^Xmax method. For each method, the lines from bottom to 
top correspond to a Gaussian uncertainty of 0, 70, 120 and 150 g cm~^. Shadow 
region is the prediction for the GZK photons [1]. Black arrows are experimental 
limits, HP: Haverah Park [20]; Ai, A2: AGASA [21,22]; Afd, Asd: Auger [23,24]; 
AY: AGASA- Yakutsk [25]; Y: Yakutsk [26]. 

It can also be seen from Fig. 7 that, in general, the optimized cut method 
results better than ^Xmax method, specially for energies bellow 10^° eV. This 
happens because the former takes advantage of the part of the distribution 
function originated by photons that do not suffer photon splitting. 

It should be noted that, after the comparison with HiRes and Auger data, 
the energy assigned to Ai and AY upper limits might be overestimated by as 
much as 20%, increasing the relevance of our technique at energies above 10^° 
eV. 



3 Mapping of proton-gamma separation onto the celestial sphere 

The events that satisfy a given cut in zenith angle and belong to a given mask 
(which actually depends on such cut) come from different regions of the uni- 
verse. In particular, there are directions in the sky for which the discrimination 
between protons and photons is larger. Fig. 8 shows maps in galactic coordi- 
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Fig. 8. Contour plots in galactic coordinates of the fraction of events with r/ > 1.3 
for E G [10l9■^1020] eV, for 6 G [30°, 60°] (top panel) and 9 G [45°, 90°] (bottom 
panel). A circular window of 5° is used for the calculation. 

nates of the fraction of events in a circular window of 5° corresponding to two 
different cuts in zenith angle 9 G [30°, 60°] (top panel) and 9 G [45°, 90°] (bot- 
tom panel) for a mask of rjum = 1-3. A uniform exposure in right ascension is 
assumed for the calculation. 

From Fig. 8 it can be seen that for 9 G [30°, 60°] the fraction of events is larger 
than for 9 G [45°, 90°], which is consistent with the fact that for larger values 
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of zenith angle the probability of photon splitting is larger. Also the regions 
on the sky where the discrimination power is larger corresponds to regions on 
the Earth surface predominantly in the south hemisphere where the maximum 
separation between protons and photons is obtained. 



4 Conclusions 

In this work we study the discrimination between photon and proton showers 
in the context of future orbital detectors. We introduce two complementary 
techniques that are based on the X^ax parameter. We find that the discrimina- 
tion power of Xmax strongly depends on primary energy due to the dependence 
of the characteristics of the photon cascades on the pre-showering effect which 
becomes more important as the primary energy increases. We also introduce 
the concept of mask which consist in regions over the Earth surface with a 
given proton-gamma discrimination power. In particular, we find that different 
masks are mapped into different regions of the sky, which means that there 
are specific directions for which the discrimination power is better. Given the 
limited exposure of any mission, the latter has implications that should be 
accounted for appropriately when applying astrophysical test over the sky. 

We also apply these new techniques to the case of an ideal mission with the 
same number of events as the one expected for JEM-EUSO. We calculate the 
upper limit on the integrated flux, assuming no photons in the sample, as a 
function of the uncertainty on the determination of X^ax- As a result we also 
obtain, quantitatively, the degradation of the performance of our techniques 
with the reconstruction uncertainty of Xmax^; showing the importance of the 
reconstruction methods and their impact on the physical analyses. 

The attainable upper limits on the photon fraction obtained by using X^ax 
with 0"[Xm(i2:] = is about one order of magnitude above the ideal case, in 
which it is known that there is no photon in the sample. This is due to the 
limitation of the X^ax parameter to separate proton from gamma showers. 
New techniques are under study, taking advantage of the richness of the spatial 
observations, in order to obtain such attainable upper limits closer to the ideal 
case. 
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